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Abstract — Traffic Engineering (TE) leverages information of 
network traffic to generate a routing scheme optimizing the traffic 
distribution so as to advance network performance. However, 
optimize the link weights for OSPF to the offered traffic is 
an known NP-hard problem (16). In this paper, motivated 
by the fairness concept of congestion control flOl . we firstly 
propose a generic objective function, where various interests 
of providers can be extracted with different parameter settings. 
And then, we model the optimal TE as the utility maximization 
of multi-commodity flows with the generic objective function 
and theoretically show that any given set of optimal routes 
corresponding to a particular objective function can be converted 
to shortest paths with respect to a set of positive link weights. This 
can be directly configured on OSPF-based protocols. On these 
bases, we employ the Network Entropy Maximization(NEM) 
framework 1 20 1 and develop a new OSPF-based routing protocol, 
SPEF, to realize a flexible way to split traffic over shortest paths 
in a distributed fashion. Actually, comparing to OSPF, SPEF 
only needs one more weight for each link and provably achieves 
optimal TE. Numerical experiments have been done to compare 
SPEF with the current version of OSPF, showing the effectiveness 
of SPEF in terms of link utilization and network load distribution. 

Index Terms — Traffic engineering, OSPF, Utility, Load balance, 
Routing 

I. INTRODUCTION 

The primary role of Internet Service Providers (ISPs) is 
to guarantee service via deploying infrastructures, managing 
network connectivity and balancing traffic load inside their 
networks IT2l . The goal of Traffic Engineering (TE) is to 
ensure efficient routing to minimize network congestion, so 
that users can experience low packet loss, high throughput, 
and low latency. Traffic Engineering leverages information 
from traffic entering and leaving the network to generate 
a routing scheme that optimizes network performance. In 
particular, an ISP solves the TE problem by adjusting the 
routing configuration to the prevailing traffic. 

In this paper, we focus on traffic engineering within a 
single Autonomous Systems (AS), in which we assume that 
the egress point of each external destination is known and 
fixed. Traffic engineering thus depends on a set of performance 
objectives that guide path selection, as well as effective mech- 
anisms for routers to select paths that satisfy these objectives 

na. 

Open Shortest Path First (OSPF) is a commonly used intra- 
domain routing protocol l24l . which provides the network 
operators a way to control network routing by configuring 



OSPF link weights. The quality of OSPF-based traffic en- 
gineering depends largely on the choice of weights. Link 
weights can have a reasonable default configuration based 
on link capacity, e.g., Cisco's InvCap |[T3ll sets the weight 
of a link inversely proportional to its capacity, which can 
be explained by the M/M/l queuing model. Although fairly 
intuitive and convenient, these setting approaches might lead to 
undesirable network load distribution, since they do not take 
the expected traffic demand into consideration. In practice, 
given network link capacities and expected traffic demands, the 
link weights can be optimized by ISPs according to a certain 
object function. However, computing the optimal link weights 
under the evenly traffic splitting scheme has been proven to 
be NP-complete lfl6l . 

Challenges. In this paper, we take an important step towards 
building an OSPF-based routing protocol that can achieve the 
optimal traffic engineering. Although this optimization prob- 
lem has attracted a great research interest and been extensively 
studied (e.g., 11181 |fl9ll , l23ll ). there are still several challenges 
to be further studied, including the following: 

1. Can we design a generic objective function to meet 
various providers' needs? Network providers are usually 
interested in various indicators to improve the network per- 
formance in different ways, e.g., some of them might prefer 
to lower the maximum link utilization, while others might 
try to minimize path lengths. Accordingly, various objective 
functions have been proposed to capture these demands. Un- 
fortunately, a set of optimal link weights with one objective 
function does not necessarily perform well with another ob- 
jective function, or may be even worse. Are there common 
features existed among these different objective functions? 
Can we design a generic objective function to meet providers' 
needs? 

2. Can we guarantee the universal existence of optimal 
link weights? Preceding researches showed that the optimal 
link weights existed with a certain kind of object functions. 
Although this outcome is encouraging to some extent, we still 
prefer to ensure the universal existence of optimal link weights 
under various objective functions. 

3. Can we achieve the optimal TE for intra-domain 
IP networks based on OSPF? As a distributed link-state 
routing protocol, OSPF uses the shortest path routing with des- 
tinations based hop-by-hop forwarding and Equal-Cost Multi- 
Path (ECMP) mechanism to evenly split the corresponding 
traffic over all available equal-cost paths. Many approaches 



are proposed attempting to achieve the "optimal" routing based 
on OSPF. Wang et al. |fl9l and Srivastava et al. ifTHl proposed 
flexible solutions to efficiently split traffic over shortest paths, 
but these centralized solutions went against the distributed fea- 
ture of OSPF. A new link-state protocol named PEFT, recently 
proposed by Xu et al. l20l . successfully realized a flexible 
traffic splitting scheme in a distributed manner, whereas failed 
to maintain the shortest paths in packet forwarding thus 
sacrificing a key benefit of OSPF. Guaranteeing the crucial 
features of OSPF in terms of scalability and efficiency are thus 
a great challenge in achieving the optimal traffic engineering 
goals based on OSPF. 

Our Approach and Contributions. Inspired by the fairness 
criterion of congestion control 1101 . we firstly propose a 
generic objective function named (q, j3) proportional load 
balance to consider various load balance demands in TE. 
Then we model the optimal TE as the utility maximization 
of multi-commodity flows and propose a distributed dual 
decomposition method to compute the optimal link weights. 
Based on these, we develop a new OSPF-based protocol, 
Shortest paths Penalizing Exponential Flow-splitting (SPEF). 
It has been proved able to achieve the optimal TE. 

Toward the optimal TE, in SPEF, we only need one more 
weight for each link. For simplicity, we hereafter refer to the 
optimal and the additional link weights as the first and second 
link weights, respectively. We use the Network Entropy Max- 
imization (NEM) framework proposed in 1201 to obtain the 
second link weights, aiming at maintaining the path diversity. 
In SPEF, packets forwarding is the same as OSPF: hop-by- 
hop along the shortest paths constructed based on destination 
according to the first link weights. When there are multiple 
shortest paths for some source destination pairs in view of 
the first link weights, the flow split ratio over the multiple 
shortest paths can be independently computed by the routers 
from the second link weights. In particular, we address the 
above challenges as follows: 

1. To capture various operators' needs, we design a new 
generic objective function motivated by the fairness concept 
in congestion control ffTOl . (q, f3) proportional load balance, 
from which a family of load balance objective functions could 
be derived to meet various providers' needs. E.g., (q, j3) 
proportional load balance could converge to min-max load 
balance with the increase of f3, making the MLU minimized. 
It can also reduce to proportional load balance with (3 = 1, 
corresponding to maximizing the product of unused capacity 
in networks. The generic objective function provides a chance 
to make a trade-off by operators, since they can just simply 
vary parameter settings according to their special needs. 

2. To ensure the existence of optimal link weights, we model 
the optimal TE as the utility maximization of multi-commodity 
flows with the generic objective function and theoretically 
show that any given set of optimal routes corresponding to 
a particular objective function can be converted to shortest 
paths with respect to a set of positive link weights, which can 
be explicitly formulated using the spare network capacity and 
objective function. 



3. To achieve the optimal TE based on OSPF, we develop 
a new routing protocol, SPEF, proving that it can achieve the 
optimal TE for intra-domain IP networks. Although we lever- 
age the NEM framework proposed in PEFT, the key difference 
between them is in that: SPEF realizes a flexible flow splitting 
over shortest paths in a distributed fashion, guaranteeing the 
crucial features of OSPF in terms of scalability and efficiency. 

Paper Organization. The rest of the paper is organized as 
follows. We propose a new generic objective function of load 
balance in traffic engineering in Section [IT] and theoretically 
prove the existence of the optimal link weights with the above 
generic function in Section [Til] The new OSPF-based protocol 
is developed in Section llVl following which is the performance 
evaluation in Section [V] Related work is summarized in 
Section I VII before we conclude with the achievements and 
extensions in Section IVIII 

II. Network model and load balance Criteria 

The notion of load balance characterizes how traffic should 
be distributed to the links. In this section, we first give the 
network model and then propose some new definition for load 
balance, which is motivated by the notion of fairness |6), iflOl . 

A. Network Model 

We consider a directed network Q = (A/", J) with vertex 
set Af, edge set J, and R source-destination vertex pairs 
{si,ti},-- - ,{s R ,t R }. Each edge has a capacity cy, 

which is a measure for the amount of traffic flow it can 
take. A demand (traffic) for (s r ,t r ) is d r , which denotes the 
average intensity of traffic entering the network at vertex s r 
and exiting at vertex t r . In the following, we use notations 
N, J to denote the cardinalities of sets Af and J respectively 
and 1Z = {1, • • • , R} to denote the source-destination vertex 
pairs index set. 

The multi-commodity flow problem is a network flow prob- 
lem with multiple commodities (or goods) flowing through 
the network, with different source and sink nodes. The more 
customary way to treat routing in a network is to consider it 
as a multi-commodity flow problem. Denote the destination 
node set with V = {teAf: 3reK s.t. t r = t}. The 
traffic flow to each destination t G T> can be regarded as a 
commodity. The flow of commodity t along edge is /*•. 
Find an assignment of flow satisfying the constraints: 

A, * E-C ' V (^)eJ (la) 

E 4 - E fl=dlVteV,Vse AT\{t}, (lb) 

fij > 0, Vi e V, (i, j) € J , (lc) 

where ([Tal l and ( TTbl are the capacity constraints and flow 
conservation constraints, respectively, and d\ > is the 
expected traffic entering the network at node s and destined 
to node t. Set <i* = d r if there exists r G 1Z such that ,s r = s 
and t r = t, or set d* = otherwise. 

We say a traffic distribution f = (fij, (i, j) G J) is feasible 
if there exists (f*, t G V) such that (f,f*,i G V) satisfies the 




Fig. 1, An example illustrating the notions of load balance for TE 

multi-commodity flow constraints ((T). If f is feasible, the total 
load on and the utilization of the link € J are and 
— respectively, which depend on how the network decides to 
route the traffic. Now, one main task is to find a appropriate 
and feasible traffic distribution f. 

An objective function enables quantitative comparisons be- 
tween different routing solutions in terms of load on the 
links. Traffic engineering usually considers a link-cost function 
$(f, c) that is an increasing function of f. Optimal traffic 
engineering Ifl4l means that the TE cost function is minimized 
over multi-commodity flow constraints ((T). 

B. Load Balance Criteria 

In order to use the network resources efficiently, spare re- 
source (such as bandwidth) are made to ensure high probability 
of data arrival to its destinations. Now we will turn to discuss 
the load balance criteria based on spare link capacity for link 



which is Si 
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It is well known that minimizing MLU is over sensitive to 
individual bottleneck links that may be difficult to avoid lfT31 . 
In addition, the maximum link utilization function does not 
penalize solutions that force traffic to traverse very long paths. 
We first use an example to illustrate that MLU is not a well- 
defined objective function. Consider the topology in Fig. Q] 
there are four edges with capacities all being Is. The nonzero 
demands are 1 for source-destination pair (1,3) and 0.9 for 
source-destination pair (3, 4), respectively. There are two paths 
for source-destination pairs (1,3), namely 1-3 and 1-2-3. 
There is a single path for source-destination pair (3, 4), i.e., 3- 
4. The link utilizations are shown in the last column of TABLE 
U There is infinite optimal traffic distribution for minimizing 
MLU. How to evaluate these optimal traffic distribution? A 
formal definition is min-max load balance. 

A traffic distribution f* is said to be min-max load balanced 
if it is feasible and for any other feasible traffic distribution f, 
the following condition holds: if sy > s*j for some G J, 

then there exists (u, v) G J such that < ^ and s uv < 

s* 

We first show that a min-max load balancing traffic distri- 
bution f* makes MLU minimized. Minimizing MLU can be 
formulated with the spare capacity as 



minimize max 



1 



(2) 



Assume that f* is min-max load balanced and does not solve 
the problem (|2]). Then there exists a feasible traffic distribution 
f such that 



max 



1 



< max 
(m)gJ 



1 



(3) 



Let = argmax^j^gj- ^1 — T 2 ^)- By ©, we have 1 — 

— < 1 — — . For f* is min-max load balanced, there exists 

(u, v) G J such that l-^>l-^-andl-f^>l-|^, 
which contradicts with (|3). 

The min-max load balancing traffic distribution for the 
topology in Fig. [T] is shown in TABLE U It can be seen that 
the min-max load balance is not overly sensitive to individual 
bottleneck links that may be difficult to avoid. But similar 
with minimizing MLU, the min-max load balancing traffic 
distribution does not penalize solutions that force traffic to 
traverse very long paths. Consider path 1-2-3 and path 1-3 for 
the source-destination pair (1,3). If the capacities in Fig. [T] 
are five times bigger, then it would not be worthwhile sending 
the traffic from 1 through a detour over 2 to 3. For it does 
not really matter that we reduce the second maximum link 
utilization from 20% to 10%. 

A traffic distribution f* is proportional load balanced if it 
is feasible and for any other feasible traffic distribution f, the 
aggregate of proportional changes of spare capacity is zero or 
negative: 



E 



<0, 



where = c.^ — is the spare capacity of link G J 
for a feasible traffic distribution f. 

A traffic distribution f* is weighting proportional load 
balanced if it is feasible, and if for any other feasible traffic 
distribution f 



E 



Qij- 



<0, 



where is a nonnegative constant for all G J . 

The following definition is a generalization of proportional 
load balance and min-max load balance. A traffic distribution 
f* is (q, (3) proportional load balanced if it is feasible and for 
any other feasible traffic distribution f 



E 



Qij- 



(4) /3 



<0, 



(4) 



fij and (3 is a nonnegative parameter. 



where = c 

The given definition reduces to that of proportional balance 
with /3 = 1. As /3 grows large, it converges to that of min-max 
load balance. 

III. Optimal Weights Existence 

In this section, we first resort to the utility maximization 
of multi-commodity flows to model the optimal TE. And then 
we theoretically prove that the optimal link weights always 
exist under the generic objective functions with different 
parameters. 

A. Utility Model of Traffic Engineering 

For the offered traffic, TE changes routing to minimize 
network congestion. Here we use the utility maximization 
solution to route traffic which is equal to the multi-commodity 



TABLE I 

Weight and link utilization for different objective functions of TE 
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B. Fortz t 


i M. Thorup |14| 


min-max 


MLU |19| 
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utilizations 


weights 


utilizations 
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utilizations 


weights utilizations 


weights 


utilizations 


(1.3) 


2 


1.00 


3 


0.67 


4.6 


0.67 


0.50 





a* 


(3,4) 


1 


0.90 


10 


0.90 


40.0 


0.90 


0.90 


1 


0.90 


(1,2) 


1 


0.00 


1.5 


0.33 


2.3 


0.33 


0.50 





1 - a 


(2,3) 





0.00 


1.5 


0.33 


2.3 


0.33 


0.50 





1 -a 



a is a constant in interval [0.1, 0.9] 



flow solution. The reason is two-fold: (a) it is optimal, i.e., it 
gives the routing with maximum spare capacity utility; (b) it 
can be realized by routing protocols that use MPLS tuneling, 
or in a distributed fashion by OSPF routing. 

We associate link (i, j) with an operator, and assume that if 
a spare capacity sy is held by operator (i, j), which has utility 
Vij(sij) to the operator. We assume that the utility Vij(sij) is 
an increasing, concave and continuously differentiable func- 
tion of sij over the range sy > 0, and Vy-(sy) > over the 
range sy > 0. Assume further that utilities are additive, so that 
the aggregate utility of spare capacity s = (s^, G J) is 

It is the concavity of the function Vy that forces load 
balance among links. If Vy is a convex increasing function 
instead of a concave, then maximize the aggregate utility. 
Larger spare capacity sy should be increased, since the rate 
of increase of Vy (sy ) is increasing in sy ■ When Vij is linear, 
the rate of increase of Vy is the same for all s^. When Vij 
is concave, a smaller spare capacity Sij is preferred, since 
V{j(x) > V{j(y) if.r- y. 

Now the optimal traffic engineering can be formulated as 
maximizing the aggregated utility under the multi-commodity 
flow constraints (fTJ. 
TE(V,a,c > D) 

maximize f t> Vij( s ij) (5a) 

subject to c - f * = s > (5b) 

Bf* =d*, Vt eV, (5c) 

where B, an N x J node-arc incidence matrix for network Q, is 
introduced to represent the multi-commodity flow constraints 
(01. The j-th column of B corresponding to link (u, v) G J 
is defined as 

!1, i = u 
-1, i = v 
0, otherwise, 

There is a unique optimum for the spare capacity vector s, 
since the objective function ( T5ab is a strictly concave function 
of s. But there may be many values of the flow vector 
(f',i G T>) satisfying relations d5bl and d5cl ). Say that s 
solves TE(V,0,c,D) if there exists (f*,i G V) such that 
(s,f*,i G T>) solves the optimization problem (0. 



From the general theory of constrained convex optimization 
J2). It follows that (s,f*, t e D) solves problem (0 if and only 
if there exist Lagrangian multiplier vectors w and G V 
that satisfy 



c 




=s, 


Bf* = 


d\ Vt G V 


(6a) 


V{j(sij) 


~ ^3 


=0, 


if 


> 


(6b) 






<o, 


if Sij 


= 


(6c) 




~ W ij 


=0, 


if f'- 


> 


(6d) 






<o, 


if f- 


= 0. 


(6e) 



we define = cy — sy as the target capacity for each link, 
which is no greater than the actual capacity cy (a "virtual" 
capacity). This is also desirable since it leads to an empty 
equilibrium. 

From Vlj(sij) > 0, Eq. d6bl and (l6cb . we have Wij > 0. The 
Lagrangian multiplier vectors w and v l have several simple in- 
terpretations. Let p : Vj Vj 1 Vj 2 ■ ■ ■ Vj m Vj m+1 be a possible path 
of source-destination pair (s,t), where jo = s and j m +i = t. 
For example, if y p = min fc= i )2 ,... , m+ i f$ s V} > 0, we have 

£(«j)gp w *3 = v t ~"s^ T,^j)ep w ^ for an y other P ath P 

that connects the same source-destination pair (s, t) under the 
conditions (l6dl l and ( f6eb . We may view Wij as the implied cost 
of traffic through link Alternatively, Wij is the shadow 

price of additional capacity at link We can also regard 

w as the weight set by the operator and v l as the vector of 
node potentials {v\ : i G A/") for destination t. 

Let w = (w^ : G J). And let (s,f*,f G V) 

be a solution of (0. We have shown that f* determines the 
shortest path for each source-destination pair (s, t) under the 
link weights w, which is determined explicitly by the utility 
function Vij and the spare capacity sy through Eq. d6bl and 
©. 

If link is charged price of per unit spare capacity, 

and is to freely vary the spare capacity sy, then the utility 
maximization problem for link becomes 

Lmkij(y i3 ;wij) 

maximize Vy(sjj') - tUySy 
subject to > 0. 

If the network receives a revenue Wij per unit spare capacity 
from link and is allowed to freely vary the spare capacity 
s^, then the revenue optimization problem for the network is 



as follows. 
Network(<5, c, D; w) 

maxiniizcft> ^2(i,j)eJ w v s v 
subject to c J2tev f* = s > (8) 
Bf* = d*, Vf e V. 

s solves Network^, c, D; w) if there exists (f* , t G T>) such 
that (s,f*,i e X>) solves the problem ®. 

Remark 1: Reducing the spare capacity s from (|8), we have 
that Network(C? , c, D; w) is a minimum cost multi-commodity 
flow problem Q, i.e. 

minimize^ E(i,j) Gl 7 SteP /ij 
subject to E te p /y < c« , V(», j) G J (9) 
Bf* = d*, Vi G V. 

B. Optimal Weights Existence 

Theorem 3.1 (weight-setting): There exists a weight vec- 
tor w = (u>ij,(i,j) G J) such that the vector s = 
i s iji(hj) G 3\ formed from the unique solution Sij to 
hmkij(Vij\Wij), solves Network(C?, c, D; w). The vector s 
also solves TE(V, Q, c, D). 

Proof: Let (s, f , i G I?) be a solution of 
TE(V,£,c,D),w = (wij,(i,j) G J) and (i/*,t G V) 
be the Lagrangian multiplier vectors, i.e., Eq. (I6all-(l6el> 
are satisfied. We have that is the unique solution s,j 
to Linky(Vy; Wy) for each G ^7. It can be check 

that (s,f,t G D) is a KKT point of Network(£, c, D; w) 
with Lagrangian multiplier vectors (wij,(i,j) G J) and 
(i/*,t G D). (s,f*,i G D) solves Network(£, c, D; w), for 
which is a convex optimization problem. 

In addition, let a vector (wij,(i,j) G JT) such that the 
vector s = (sij,(i,j) G J), formed from the unique 
solution s.^ to Lmkij(Vij;Wij) for each G J, solves 

Network(<5, c, D; w). Then there exists flow vector (f , i G T>) 
and Lagrangian multiplier vector (jpij, G J) and (q*,£ G 
2?) such that 



c -E ft 


= s, 


Bf* = 


d*, Vt G V 


(10a) 














= o, 


if Sij 
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(10b) 




< o, 


if Sij 
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(10c) 


9j - 9* - Pij 


= o, 


if ft. 


> 


(10d) 




< o, 


if f* 


= 0. 


(lOe) 



Furthermore, by that s^j solves Link,;,- (V^- ; we have 
^j'( s ij) = if s y > 

and 

V-jisij) < Wij,ii s^ = 0. 

Replacing Eq. (llObb and (11 Oct by this condition, we have 
that (f, s) satisfies conditions (f6ab-(f6el> by replacing w and 
v l by p and q* respectively. This establishes that s solves 
TE(V, Q, c, D), and hence the final part of the theorem. ■ 




Load 

Fig. 2. Different link cost as a function of the load for a link capacity 1, 
where FT denotes the one proposed by Fortz and Thorp 1141 and qij = 1 in 

m 

We now examine the engineering implications of Theo- 
rem 13.11 It is true that, the Lagrangian multiplier vector 
(wij,(i,j) G J) gives link weights such that all the traf- 
fic flow will be forwarded along the minimum cost multi- 
commodity problem solution. Meanwhile the link max- 
imizes it's utility through retaining a proper spare capacity. 
Inversely, if there exists link weights (wij,(i,j) G J) such 
that the vector s = (sij, G J), formed from the unique 
solution to Linkij(Vij;Wij) for each G J, is the 

same with the solution of minimum cost multi-commodity 
problem (0, then {wij,(i,j) G J} is a set of link weights 
such that all the commodity flow will be forwarded along the 
shortest paths. Meanwhile, s solves traffic engineering problem 
TE(V,a,c,D). 

Lemma 3.2: Let g(x) be continuously differentiable, i.e. 
Jj- exists and continues for all i. It holds that <?(x) is concave 
if and only if 

. 9 (x)- 5 (x*)<V ff (x*) T (x-x*) 

holds for any x and x* (see 13 and |4]). 

Theorem 3.3: A traffic distribution f* is (q, /3) propor- 
tional load balanced if and only if s* = c f* solves 
TE(V,Q, c, D), where the objective function in (|5al ) is given 
by 

V ^-{ «y(l if,'. I. (U) 

Proof: Let g(s) = E(, j)<zj Vij(sij) and s* be a solution 
of (f5]) with objective g(s). Letf* = c-s* and (w*j, G J) 
be a Lagrangian multiplier vector, i.e., satisfying (I6al)-(l6el>. Let 
f be any feasible traffic distribution. Then s = c f > 0. 
Multiplying Eq. d6bb and d6cb by s,j — s*j and summing over 
G J, we find (V 5 (s*)) T (s-s*) < T,(i,j)eJ w ij( s n - 
s*j) < since s* solves Network(C?, c, D; w*) (known in the 
proof of Theorem 13. 11 1. Therefore, 

(V 5 (s*)) T (s-s*) <0. (12) 

By the definition of g(s), we have = So Eq. 

( fl2l i reduces to Eq. ©. We have shown that f* is (q, /3) 
proportional load balance. 




(a) Weight vs load balance parameter /3 with qij — 1 (b) Link utilization vs load balance parameter /3 with qij — 1 

Fig. 3. An example illustrating the notions of load balance for TE 



For the converse, assume that f* is (q, /3)-proportional load 
balance and s* = c — f*. So Eq. holds with f*, i.e., Eq. 
fT2"V For <?(s) is concave, we have g(s) — g(s*) < holds 
for any feasible traffic distribution f such that s = c — f by 
Lemma [3721 It follows that s* solves TE(V, Q, c, D), where 
the objective function in Eq. ( f5ab is defined by Eq. (fTTt . ■ 

Based on Theorem 13. II and Theorem 13.31 we can give the 
engineering interpretation of some specific (q, (3) proportional 
load balance. 

Example 1: Proportional load balance. 

If a traffic distribution f is proportionally load balancing, 
then it solves the TE problem © with Vij (sij ) = log s»j . From 
Eq. d6bb and d6cb . we can get Wij = — z~f—i l - e - me average 
packet delay on link is based on the M/M/l queueing 
model JT1, where = J^tev fij- F rom me discussion above, 
we have that if path p* for (s, t) bears positive traffic y p * > 0, 

^en £( W )€p* 7-^7- < E(<j)ep T^J~ for an y other P ath P 
for (s,t). The facts above show that the proportional balance 
vector f not only minimizes the average packet queueing delay 
of (s, t) for all s, t G Af, but also minimizes the average delay 
over all the links. 

If a network is running with low utilization, then fa <C 
ca, and therefore, the delay — ^—r- ps — . As such InvCap 

J J Cij—Jij Cij 

recommended by Cisco can be suitable. When the link load 
is non-negligible as compared to its link capacity, we should 
make some changes. 

Example 2: (c, 2) proportional load balance. 

If a traffic distribution f is (c, 2) proportionally load balanc- 
ing, then it solves © with Vij(sij) = c ~l'f. = — 1— — .^jj. . 
In this case, we can see that (© tries to minimize the total 
average queueing delay by the M/M/l queueing model with 
respect to optimal link weights Wij = ^..^..y f° r (h j) G J ■ 

Example 3: (d, 0) proportional load balance. 

Let dij be the processing and propagation delay on link 
If a traffic distribution f is (d, 0) proportional load 
balance, then it solves the TE problem (0) with Vij(sij) = 
dij(cij — fij) = dij — dij fij. In this case, we can see 
that (© tries to minimize the total processing and propagation 
delay, and we have that the optimal link weights w%j = dij 
for unsaturated link £ J and Wij > dij for saturated 

link If d^ = 1, we have the minimum hop routing. 

We use the network topology in Fig. Q] to illustrate these 



notions. In Figf3] (a) and (b) are the link weights and the 
link utilization versus load balance parameter /3, respectively. 
Detailed numerical results are shown in TABLE U 

Remark 2: Consider TE(V, G, c, D) with Vij defined in 
( fTTT i with q.ij = l,V(i,j) G J, we obtain: the minimum 
hop routing for each source-destination pair with /3 = 0; 
the shortest average packet delay routing for each source- 
destination pair with (3 = 1; the shortest paths for each source- 
destination pair which makes the traffic distribution be min- 
max load balance when /3 — > oo. 

C. Utility vs. Proportional Load Balance 

In this subsection, we discuss the relation between the 
proportional load balance and different utility functions. If 
link can choose an amount to pay per unit time, mj, 

and receive in return a spare capacity proportionally to 
riij, say = where could be regarded as a charge 
per unit flow for link (i, j), the utility maximization problem 
for link (i, j) becomes 
Lmkij(Vij;Wij) 

maximize K, (^-) — n,-, 

Il »'> J 3 (13) 
subject to iiij > 0. 

Let n = (ny, G J),V(n) = G J : n t] > 0}. We 

define the optimization problem 
Network(<5, c, D; n) 

maximize,* > J2(i,j)eT>(n) n H lo § s »i 
subject to c Step f* = s > (14) 
Bf* = d { , Vt G V. 

Note that if = 1 for G J, then the solution to 

Network(f/, c, D; n) is the proportional load balancing traffic 
allocation. If riy, G J, are all integers, then the solution 
to Network((J, c, D; n) can be constructed as follows. For each 
ihj) S J, replace the single link by identical sub- 
links, calculate the proportional load balance allocation over 
the resulting J2u j)<zj n>ij traffic, and then provide link 
the aggregate spare capacity allocated to its riy associated 
sub-links. The load per unit charge are then proportional load 
balancing. 

Say that s solves Network(C?, c, D; n) if there exists (f* , £ G 
V) such that (s,f*,i G T>) solves the optimization problem 



( TBi i. The corresponding Lagrangian is 

L Not (s,f*,i G2);w,!/',i 6 5) 

= E(ij)ec( n ) n y lo S s y + wT ( c - J2tev {t - s ) 
-E* eD " tr (Bf*-d*) 

= S(i,j)eX>(n)( n y l°g s ij — w ij s ij) ~ S(i,j)0U(n) w ij s ij 

+ Etev ifrfleArf ~ v i ~ w v)fti 

For the general theory of constrained convex optimization Q, 
it follows that (s, f f , < 6 T>) solves problem ( fT4t if and only if 
there exist Lagrangian multiplier vectors v t and w that satisfy: 

c - Y,tep f * = s > Bf * = d *> ^ teT> 
~^-Wij =0, if {i,j)eV(n) 

-Wij = 0, if <£ X>(n),sy > 

-Wij < 0, if <£ £>(n),sy = 

0, if Hi > 



v]-v\- Wij 



< 0, if ^ = 0. 



Theorem 3.4: There exist vectors n = (ny, £ 
J^w = (wij,(i,j) G J), and s = (sy,(£,j) £ J") such 
that 

i) lUy > and ny = WySy, for (i, j) G J"; 

ii) ?iy solves LAnky(Vy; iDy) ( Tl3T i. for £ i7; 

iii) s solves Network(C/, c, D; n) l fl4V 

Given any such triple (n, w, s), the vectors n and s are 
uniquely determined, and s solves TE(V,G,c, D). 

Proo/- Let (s,f*,i £ 2?) be a solution of ©. Let w 
and 6 2?) be the Lagrangian multiplier vectors, i.e. 

the conditions of (I6al>-(l6el> are satisfied. For V'(sy) > 0, 
we have > V^(sy) > from (l6bl and d6cT >. Let 



n-ij = WijSij, £ i7. Then i) of Theorem 13.41 holds. 

As Wij > for all 6 J, Linky(Vy; ny) is well 

defined. In addition, it is obvious that ny = if and only if 



Sij = 0. We have that ny solves Linky(Vy; 



for e 



J by <|6b> and Then ii) of Theorem Il4l holds. 

By i) of Theorem |14] we have the fact that X>(n*) = 
{(i,j) G J" : ny > 0} = € J : sy > 0}. Then the 

condition (Illl-Cb for Network(Cy, c, D; n) is disappear. By the 
definition of n and w, the conditions dlll-Q and (Illl-Cb hold. 
The other conditions follow from the conditions d6aK d6dl i and 
(l6eb . We have the fact that s solves Network((J, c, D; n). Then 
iii) of Theorem 13.41 holds. 

Conversely, given n, w and s satisfying conditions i)-iii) of 
Theorem 13.41 then by i), Linky(Vy; iDy) is well defined for 
a ll {hi) £ J ■ in addition, we have that ny = if and only 



if Sij = 0. By ii) and sy = — !i , the conditions (16b t and 
hold for given s and w. By iii), there exist f* and v l for all 
t eV satisfying conditions dlll-O . dlll-O and (IIII-O . We can 
verify that (s,f*,t G V,Vf,v t ,t e V) satisfies <[6aJ - d6ej . We 
conclude s solves TE(V, Q, c, D) and therefore s is uniquely 
determined. Since ify > for all G J, n is uniquely 

determined as well. ■ 



Since Theorem 13.41 is straightforward, here we do not 
present the detailed proof. It shows that if each link operator 
is able to choose a charge per unit time prepares to pay. And if 
the network allocates spare capacities so that the spare capacity 
per unit charge is proportional load balancing, then a system 
optimum is achieved when the link operator's choices of 
charges and the network's choice of allocated spare capacities 
are in equilibrium. 

IV. A New routing protocol: SPEF 

We are now in a position to design a new routing protocol 
based on the above theoretical results. In the following, we 
first present the distributed algorithms to achieve the optimal 
link weights, also called the first link weight. And then we 
derive the second link weights from the conceptual framework 
Network Entropy Maximization l20l . 

In the Shortest paths Penalizing Exponential Flow-splitting 
(SPEF), each router can construct the shortest paths for each 
destination based on the first link weights and independently 
calculate the traffic split ratio among all equal-cost shortest 
paths using only the second link wights, not only achieves the 
optimal traffic engineering but also remains the path diversity. 

A. Obtaining the First Link Weights 

We now show a distributed algorithm to obtain the first link 
weights, which in fact is the sub-gradient projection method 
JfQ applied to the dual of TE(V, £7, c, D). The algorithm 
comprises three parts: updating the weight vector, specifying 
the spare capacity and modifying the routing variables, as 
described in Algorithm 1. 

Algorithm 1 Dual decomposition for the first link weights 



Given tolerance tol and initial weis ht w luJ (such as w 
l/ ClJ ),fc = 0; 

for the given weight do 

Each link solves Linkj^V^-; to find 

the spare capacity S ** ; 
Each destination t G T> solves Routet(w' fe '; d 4 ): 

minimize^ > w ij ] fh 



,«)) 



subject to 



Bf = d* 

*(fe). 



(15) 



to find the routing variable f 
Each link G J updates the link weight 



(fc+l) I (k) 



)).; (16) 



k <- k + 1; 

Until gap(w (fc) ,s (fe) ,f (fc) ) < tol. 
end for 



Given the link weight w, the route problem ( fl5l ) for each 
destination is a minimum-cost network flow problem 0. In 
([Tol l. 7^ is the step size and (z) + = max(0, z). And optimality 
measure is defined as the dual gap, i.e. 



gap(w«s«f«)= J2 (E^ 



(fc) 

ij 



(fe) 



tev 



Theorem 4.1: The link weight sequence {w^ fe ^} generated 
by Algorithm 1 converges to the first link weights w* if 
Tlk^ k ~ 00 an d T fe 0- Furthermore, if there are no 
saturated links, i.e. s*j > 0,\/(i,j) G J, the first link weights 
w* is uniquely determined and the optimal traffic distribution 
is f = c - s*, where s*j = V£ _1 (<«?•)• 

We have proposed a link weight configuration method that 
can achieve the optimal traffic engineering. We can determine 
the set of shortest paths ON = {ON* : t e V} (i.e., deciding 
which outgoing link should be chosen on the shortest path) 
based on the first link weights, where ON* is the shortest path 
set for any node s G Af to destination t G T>. Specifically, SP r 
denotes the shortest path set for (s r , t r ). Let SP = {SP r : r G 
TZ}. When the first link weights generate multiple equal cost 
paths for a source-destination pair or next hops for a given 
destination routing prefix, we need to split the traffic among 
the multiple shortest paths or the next hops to keep paths 
diversity while achieving the optimal traffic engineering. 

B. Obtaining the Second Link Weights 

Motivated by PEFT 11201 . we propose an Exponential- 
weighted flow split in the presence of multiple equal cost 
paths for a given ingress and egress pair (s r , t r ). The proposed 
method features that each router can independently compute 
the flow split only based on alternative link weights, where 
routers can direct traffic on the shortest paths determined by 
the first link weights. This method can achieve network-wide 
traffic engineering objective through OSPF which still keeps 
the simplicity and scalability of link-state routing protocols. 

We maximize the relative entropy of the traffic split vector 
among the multipath in SP 7 to maintain the path diversity. 
Maximizing the relative entropy |4| of the traffic split vector 
can be formulated as follows. 
NEM(SP,f,D): 

maximize — d r V^Pfe ^°SPk (17a) 

reTZ k=l 

subject to Z! drPl^ftjMhj) e J (17b) 

ren k-.(i j)6Spj: 

£>£ = l,Vreft, (17c) 
fe=i 

where n r denotes the number of the shortest paths from s r to 
t r . SP£. denotes the fc-th shortest path from s r to t r . 

We will connect the characterization of optimal solution to 
NEM that is realizable with hop-by-hop forwarding to expo- 
nential penalty. Let (p r ,r G TZ) be a solution of H7i . Then 
there exist Lagrangian multipliers vector v = (uy, G J) 
and (y T ,r G TZ) satisfying that (l + logPfc) + ^ (ijJ - )eS pr % + 
^j- = 0, Vr G 1Z, k and YHk=i Pk = ^ Under these conditions, 
we have 

Pk = f4 ""-vr . Vr G TZ, k, (18) 

where v' k = Y^u j)esp r Vi r ^ n me following, we refer to 
Lagrange multipliers vector v as the second link weight. v r k is 



TABLE II 

Forwarding table for SPEF routing. 


Next hop 


Lengths of multiple equal cost shortest paths through 
link (s, next hop) to t in view of the second link weights 




\ L 11 ' ' "in, I 








,(',*) ... l«.tj \ 



the length of path SP£ with respect to the second weight v. 

Theorem 4.2: The optimal traffic engineering for a given 
traffic can be realized with the second link weights using 
exponential flow split (fl~8b . 

To provide a foundation for the second link weight 
computation, we investigate the Lagrange dual problem of 
NEM(SP, f, D) and a dual-gradient-based solution. Denote the 
dual variables for constraints ( 1 17bb as Vij for link (or v 
as a vector). We first write the Lagrangian L(p, v) associated 
with problem NEM(SP,f, D) as 

L (P> v ) = -J2 dr I2 ( Pk l °SPk + v r k Pk)+ v vtiv 
ren fc=i {i,j)ej 

where v k = j)esv r , Vi r ^ ne Lagrange dual function is 

d(v) = maximize X(p, v) 

subject to Y^k=iPk — 1' Vr G TZ. 

The dual problem is then formulated as 

minimize rf(v) subject to v > 0. (19) 

To solve the dual problem, we first consider the maxi- 
mization of the Lagrangian over p. Note that, the L(p,v) 
is separable for a given dual variable v, i.e., the traffic split 
subproblem for each r G TZ is independent of the others since 
they are not coupled together with link capacity constraint 
(I17bb . So we can solve a subproblem (120b below for each 
r G TZ separately: 

maximize -d r £fc=i (p r k \ogp r k + v r k p r k ) 

subject to J2k=iPk = 1 - 

Then, the dual problem (T% can be solved by using the 
gradient projection method as follows for iterations indexed 
by k, 

v% +1) = -7(/5 -E,^^E i:(lJ)e sp r fr (fc) )) + 

(21) 

where 7 > is a constant step size, (p^ k \ ■ • ■ ,p„ ^) are 
solutions of the traffic split subproblem (l2Qb for v( k \ and 
is the total flow on link G J. 

It is important to note, from (f2TT > in iteration k + 1, the 

(k) 

procedure of link weight updating needs /y , the aggregate 
bandwidth usage. We now show how to calculate it efficiently. 

First, we need to establish the forward table for node s 
to destination t as shown in Table [II] where n k denotes the 



number of shortest path from node s through node to node 
is the length of the j-th path from node s through 



t, v 



(s,t) 

kj 



= 1: l->2, </,=4 
= 2: l->3, d,= 



3: 3-> 2, d,=A 
r = 4: l->7, d 4 =4 



| 2 | 0.5832] 



node Vk to node t, and m a denotes the number of next hop 
for s in ON*. Then the traffic to destination t can be splited 
according to the following formula: 



r* («,«*) - 



2 — 1 



(22) 



Finally, the formal algorithm for the second link weights 
can be described as follows, in which Algorithm 3 is needed 
to get the traffic distribution matching to the current second 
link weights v' fc ^. 





Fig. 4. A simple network topology 
and traffic demands 



Fig. 5. SPEF forwarding table for 
destination 2 



Algorithm 2 Dual decomposition for the second link weights Algorithm 4 SPEF routing 



Input the optimal traffic distribution f* and tolerance e; 
Given the initial second link weig hts v (0) = 0, k = 0; 
For the given weights v' fc ', do 

Get the traffic distribution matching to v' fc ', i.e. 

f (fe) <- TrafficDistribution(v (fc) ). 

Each link updates the second link weights 

-r i, -(^ , -7(^-i# , )) + ; 

k <- k + 1; 
Until < /* + e for all G J. 



Running Algorithm 1 to obtain the first link weights (w%j, (i, j) G J) 
and optimal traffic distribution f*. 
For each destination node t G T> do 

Run Dijkstra's algorithm with the first link weights 
to get all the shortest paths ON = {ON* : t G V}. 
end for. 

Running Algorithm 2 to obtain the second link weights (Vij, G 
J). 

For each t G V do 

For each source node s: 

Establish the forward routing table shown in Table [TT1 

end For 
end For 



Algorithm 3 TrafficDistribution(\) 

Input ON = {ON 4 :!£»}; 

Compute the path length for each path in ON 

in view of the second link weights v; 
Compute the traffic split r 4 (i,j) according to J22b : 
For each destination t do 

Do sorting on the distance of node s to t 

in view of the first link weights 
Each source s ^ t in the decreasing distance order do 

d s t = d st + E(j, s )eON' fi s ' 
For all j such that (s,j) G ON* 

end for 
end for 

fa = E* eD /l/ fora11 (i,j)£J; 

Return /* set of f */ 



Here d s t denotes the total incoming flow destined to node 
t at node s (including traffic originating at s as well as any 
traffic arrived from other nodes). 

The following result can be proved with standard conver- 
gence analysis for gradient projection algorithms 0: 

Theorem 4.3: Let {v^ } be the sequence generated by 
Algorithm 2. We have that {v^} converges to the optimal 
dual solutions v*, and the corresponding primal variables p* 
according to < fT~8T > are the globally optimal solution of ( fTTl ). 

We now present a new link-state routing with hop-by-hop 
forwarding, which can achieve the optimal traffic engineering. 



V. Performance Evaluation 

How well can the new routing protocol SPEF perform? In 
the first part, we will illustrate its performance with a simple 
example. In the second part, we demonstrate the performance 
of SPEF with numerical experiments over a real backbone 
network and several synthetic networks. Here we compare the 
results of SPEF with that of OSPF, which sets link weight 
inversely proportional to its capacity and evenly splits the 
traffic over multiple equal-cost shortest paths. 

A. An Example 

Fig. |4] shows a simple network topology, as used in |fl9l . 
Each link has a capacity of 5 units and each demand needs a 
bandwidth of 4 units. For simplicity, we omit six links unused. 
The numbers on the links are the link indices. 

The link utilizations for optimal TE with a different param- 
eter j3 are shown in Fig. [6] For the results of (3 = 0, link 1 is a 
bottle link. And the first link weight is 3. The first link weight 
of others are all 1. Considering link 1, the link utilization is 
decreasing in /?. From Eq. d6bb . the first weight of links 2 
and 3 are the same when /3 = 0, 1 or 5, since all the spare 
capacities are equal to 1. For j3 = 1, from Figj7] (b), it can 
be seen that all the second link weights are zero except for 
link 1 and link 5. The fact that the second weight of link 1 
is increasing in /3 shows we route fewer traffic through link 1 
with larger /?. 
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(a) The first link weights (b) The second link weights 

Fig. 7. The first and second link weights for the network topology shown in Fig. [4] with different /3 




TABLE III 
Properties for different networks 



Fig. 6. The link utilization for the topology shown in Fig|4] 



Net. ID 


Topology 


Node # 


Link # 


Abilene 


Backbone 


ll 


28 


Cernet2 


Backbone 


20 


44 


Hier50a 


2-level 


50 


222 


Hier50b 


2-level 


50 


152 


Rand50a 


Random 


50 


242 


Rand50b 


Random 


50 


230 


Rand l 00 


Random 


100 


392 



B. Simulation Environment 

The properties of the networks used are summarized in 
TABLE [Hi] The real backbone network, the Abilene network 
and Cernet2 network shown in FigJH] The first network has 
11 nodes and 28 directional links with lOGbps capacity, and 
the latter has 20 nodes and 44 directional links with lOGbps 
capacity for 4 backbone links and 2.5Gbps for others. The 
traffic demands for Abilene network is generated as those 
in Fortz and Thorup |[T6l . The traffic demands for Cernet2 
network are generated by a gravity model with the link 
aggregated load extracted from the sample Netfiow data, which 
was captured during 2010/1/10 to 2010/1/16. To simulate 
networks with different congestion levels, we create different 
test cases by uniformly increasing the traffic demands until 
the maximal link utilization almost reaches 100% with SPEF. 

We also test the algorithms proposed in this paper on the 
same topologies and traffic matrices as in Fortz and Thorup 
lfl6l . The 2-level hierarchical networks were generated using 
GT-ITM, which consist of two kinds of links: local access 
links with 1 unit capacity and long distance links with 5- 
unit capacity. In the random topologies, the probability of 
having a link between two nodes is a constant parameter, 
and all link capacities are 1 unit. In these test cases, for 
each network, traffic demands are proportionally increased to 
simulate different congestion levels. 

For SPEF, we employ the utility function with /3 = 1 to 
determine the first link weights. The utility is normalized, 

which means Y^u j)e,7 ~ u t?')> wnere u ij is the link 

(i,j)'s utilization. The utility is — 00 if MLU is greater than 
1, which is not shown in Fig. [10] 



C. Performance Comparison Against OSPF 

The sorted link utilizations for Abilene network and Cernet2 
network are shown in Fig. [9] where the network load is the 
ratio of total demand over the total capacity. Typical results 
for different topologies are shown in FigfTUl 

From Fig. [9] it can be seen that some underutilized links 
in OSPF are used efficiently in SPEF. At the same time the 
traffic on the over-utilized links in OSPF is removed in SPEF. 
The results shown in Fig. [10] indicate that the utility difference 
between SPEF and OSPF becomes obvious with the increasing 
of network load. SPEF still works when MLU of OSPF is 
greater than 1 . 

D. Performance Comparison Against PEFT 

In order to make a comparison between SPEF and PEFT in 
network environment, we resort to SSFnet, a highly efficient 
simulation tool, to explore the protocol behaviors in networks 
with different scales. In the simulation, both the simple net- 
work in Fig. [4] and Cernet2 backbone network in Fig. [8jb) 
are used, and the traffic demands are shown in TABLE [TV] 
Accordingly, it can be divided into two parts. 

First, SPEF and PEFT separately run for 400s on the simple 
network with each link capacity set to be 5Mb/s. The mean 
traffic load on each link is shown in Fig. [TTT a). of which the 
X axis represents link index and the Y axis is the mean traffic 
load in kbps. The result shows that in PEFT altogether 8 links 
are used for carrying traffic, and the link loads vary severely 
from 1000 kbps to near 3000 kbps. Comparing to PEFT, 4 
more links are involved in SPEF and the traffic load is more 
equally distributed among these links. 



(a) Abilene network 



(b) Cernet2 network 

Fig. 8. Backbone network topologies 




Fig. 9. Comparison of SPEF and OSPF in terms of the sorted link utilization 




Second, we run SPEF and PEFT for 400s on the Cernet2 
backbone network, where the capacity of 4 links marked with 
bold lines is lOGbps, four times larger than that of the rest 
links. The mean traffic load on each link is shown in Fig. 
rTTT b). The meaning of both X axis and Y axis are the same 
with those in Fig. [TTTa). except that the link load is measured 
in Mbps. Three more links is used in SPEF than that in PEFT 



and hence the variation of link load is lower. 

In the above simulation cases, SPEF always leverages more 
links for packet delivery than PEFT, which can be explained 
by looking deeply into the forwarding tables of each protocol. 
Although in PEFT traffic can be intuitionally split over all pos- 
sible paths between the source and destination, the penalizing 
exponential flow-splitting mechanism prefers the shortest path 



TABLE IV 

Traffic demands in comparison between SPEF and PEFT 



Net.ID. 


Src.ID Dst.ID Demand # 


Simple network 
in Fig. |4] 


1 2 4Mb 
1 3 4Mb 
3 2 4Mb 
1 7 4Mb 


Cernet2 Backbone 
in Fig.Ub) 


11 1 3Gb 
11 2 2Gb 
11 20 2Gb 

13 6 1Gb 

14 1 4Gb 
14 8 2Gb 



TABLE V 

Comparison of SPEF and OSPF in terms of the number of equal 

COST PATH FOR EACH INGRESS -EGRESS PAIR 



Routing 


Network loading 


m 


"■2 


n 3 


n 4 


OSPF 


0.13, 0.17, 0.21 


355 


25 










0.13 


330 


48 





2 


SPEF 


0.17 


325 


53 





2 




0.21 


321 


54 


3 


2 



while penalizing the longer paths. In SPEF, however, multiple 
equal-cost shortest paths for the same source-destination pair 
are constructed with a higher probability based on the first link 
weight, and then traffic is split over these paths according to 
the exponential ratios computed by the second link weight. 
The comparison result infers that SPEF outperforms PEFT in 
terms of load balance. 

E. Equal Cost Paths 

One of the key features of SPEF routing is the ability to 
balance traffic across multiple equal-cost paths. Intuitively, 
SPEF routing is more likely to use multiple paths to balance 
traffic at higher loads. Hence, we focus on a different utiliza- 
tion scenarios for Cernet2 network, for which we compute the 
number of equal cost paths used by SPEF routing. TABLE 
[Vl shows the results, where rij denotes the number of ingress- 
egress pairs that have i equal cost paths. It can be seen that the 
equal cost paths for some ingress-egress pairs are increasing 
with the increase of network load. But OSPF routing has not 
change with the network load. 



F. Convergence Behavior 

In Algorithm 1, the initial link weights = — for 

° ' ° %3 Cij 

all link G J are a proper choose. The step sizes in 

Algorithm 1 can be constant or dynamically adjusted. We find 
that setting the step size in Algorithm 1 to the reciprocal of 

the maximum link capacity -. — \. ., performs well in 

practice. Fig. [T2] (a) shows the evolution of dual objective 
value of TE obtained by Algorithm 1 with different step sizes, 
within the first 2000 iterations for Cernet2 network. It provides 
convergence behavior typically observed. The legends show 
the ratio of the step size over the default setting which is 



max{c- \i j)ej\ 1 ^ demonstrates that Algorithm 1 developed 
for the SPEF routing convergence very fast with default 
setting. Algorithm 1 reduces the dual objective value of TE to 
-48 after 100 iterations and -49 after 500 iterations. In addition, 
increasing step size a little will speed up the convergency, and 
as expected, too large a step size (e.g., 2 for Algorithm 1 in 
the above example) would cause a little oscillation. Notice that 
there is a wide range of step size that can make convergence 
very fast. 

In Algorithm 2, the initial link weig hts vlf = for all 
link G J are a proper choose. We find that setting the 
step size in Algorithm 2 to the reciprocal of the maximum 

optimal traffic distribution f \ . performs well in 

practice. Fig. Q~2] (b) shows evolution of dual objective value 
of NEM obtained by Algorithm 2 with different step sizes for 
Cernet2 network. It provides convergence behavior typically 
observed. The legends show the ratio of the step size over 
the default setting which is max |y. -rn jjglTT ■ It demonstrates 
that the initial link weights for Algorithm 2 are a good 
approximation solution for the dual problem of NEM. And 
Algorithm 2 developed for the SPEF routing also convergence 
very fast with default setting. Algorithm reduces the dual 
objective value of NEM to 0.6695 after 100 iterations and 
0.66945 after 300 iterations. In addition, increasing step size 
a little will speed up the convergency. Notice that there is a 
wide range of step size that can make convergence very fast. 

G. Noninteger Link Weights 

We should point out that Algorithm 1 is not guaranteed 
to yield exact integer solutions for the first link weights. 
In practice, routing protocols link OSPF and IS-IS have a 
finite field width for link weight information. To guarantee 
the weight for the link with maximum spare capacity is 1, we 
get the integer weights as following 



Waa = round 



(max{s y : G J}) , V(£, j) G J, 



where round(a;) means rounding x to the nearest integer and 
Wij is the first link weight obtained with Algorithm 1 . This is 
because the modified link weights can result in routings that 
are different from the optimal routing. Hence it is important 
to study how errors in link weights influence performance. 

There are two factors that can introduce inaccuracies in link 
weights. First of course is the precision in rounding off link 
weights. The second factor is the nonzero tolerance required 
by Dijkstra's algorithm. This implies that the optimal link 
weights (and path cost) are accurate only within a certain 
tolerance. For example, two path costs are treated to be equal 
by Dijkstra's algorithm if the difference in costs is less than the 
specified tolerance. We specify the tolerances for the Dijkstra's 
algorithm are 0.3 and 1 for noninteger weights and integer 
weights respectively. 

FigH3] shows the impact of integer weights on utility 
for Abilene network and Cernet2 network. Observe that the 
integer weights has little impact on utility for the low network 
loading. At higher network loadings, errors due to integer 




(a) Link load distribution over the simple network in Fig. [4] (b) Link load distribution over the Cernet2 network in Fig.[8]b) 

Fig. 11. Simulation results of SPEF and PEFT using SSFnet over different networks 




Iteration 

(a) Evolution of dual objective value of Algorithm 1 (b) Evolution of dual objective value of Algorithm 2 

Fig. 12. Evolution of dual objective value obtained by Algorithm 1 and Algorithm 2 with different step sizes for Cernet2 network 



tolerances comes into play so that the utility starts to deviate 
significantly. This is because, the first link weights will be 
increasing with the link load while the tolerance for the 
Dijkstra's algorithm is specified. In order to avoid problems 
due to such errors, we use the different tolerance for the 
Dijkstra's algorithm with the different network loading. 

VI. Related work 

Among the papers focused on TE, MLU ||T9l and piecewise- 
linear approximation of the M/M/l delay formula lfl4l are 
two frequently-used cost functions. Minimizing MLU ensures 
that the traffic is moved away from congested hot spots to less 
utilized parts of the network. The latter formula proposed by 
Fortz et al. lfT4l is based on discussions with the technicians in 
AT&T Lab. A description of the general infrastructure behind 
this kind of traffic engineering is given in lfl5l . Srivastava et 
al. lfl"8l constructed a composite cost function which was a 
positive linear combination of the used capacity and MLU, 
and then proposed a heuristic hybrid method combining the 
sub-gradient projected method and a genetic algorithm to 
determine the link weight system. Di Yuan |23l proposed an 
approach for robust OSPF routing using an artificial objective 
function embedded into a local search algorithm. 

In the research group of congestion control, researchers are 
mainly concerned with fairness and efficiency. Network utility 
maximization (NUM) J5), especially the proportionally fair, is 
a trade-off objective for this aim. In addition, to design the 
end-to-end algorithms for joint routing and rate control, many 
following researches replace capacity constraints with barrier 
functions that specify the congestion cost at the link (e.g., 0, 



and ||8)). Generally, a function &ij(fi 3 ) = J c p 1 j(u)du 
is defined, which can be regarded as a penalty function that 
describes the rate at which the cost is incurred at resource (i, j) 
with capacity c(i,j) when the load through it is fy. He et 

al. ifTn choose &(fij,Cij) = e Ci J to model M/M/l queuing 

hi. 

delay, which is related to the price function pij (fij) = —e, ai ' . 
Xu et al. in ll2D defined «!>, ,(/, , • = —qij ln(cy — fij), which 
is related to the price function Pij(fij) = — ^zj. ■ 

Based on the results derived from linear programming, 
Wang et al. Ifl9l proved that any arbitrary set of routes can be 
converted to shortest-paths with respect to some set of positive 
link weights. This implies that the shortest path limitation is in 
itself not a major hurdle. Fortz et al. Ifl6l showed that optimiz- 
ing the link weights for OSPF with evenly split over ECMP 
to the offered traffic is an NP-hard problem and proposed a 
local search heuristic. Sridharan et al. lUTl used a centralized 
greedy computation to select the subset of next-hops for each 
prefix to attain load balance much better than even splitting 
among the shortest paths. But these solutions fail to enable 
routers to independently compute the flow-splitting ratios only 
using link weights. PEFT, recently proposed by Xu et al. 
||20l , is a promising link-state routing protocol splitting traffic 
over multiple paths with an exponential penalty on longer 
paths. In order to prevent loops and promote computational 
efficiency, PEFT used Downward PEFT for traffic splitting, 
which does not provably achieve optimal TE lEOl . PEFT shed 
a new light for further studies on developing an OSPF-based 
protocol, which enables routers to independently make traffic 
split decisions while maintaining the shortest paths. 




VII. Conclusions 

In this paper, we explore the problem of achieving the op- 
timal traffic engineering in intra-domain IP networks. Firstly, 
we propose a new generic objective function, where various 
interests of providers can be extracted with different parameter 
settings. And then, we model the optimal TE as the util- 
ity maximization of multi-commodity flows and theoretically 
show that any given set of optimal routes corresponding to 
a particular objective function can be converted to shortest 
paths with respect to a set of positive link weights, which 
can be directly configured on OSPF-based protocols. On these 
bases, we develop a new OSPF-based routing protocol, SPEF, 
to realize a flexible way that splits traffic over shortest paths 
in a distributed fashion. The inspiring fact lies that comparing 
to OSPF, SPEF only needs one more weight for each link and 
provably achieves optimal TE. Numerical experiments have 
been done to compare SPEF with the current version of OSPF, 
showing the effectiveness of SPEF in terms of link utilization 
and network load distribution. 

A direction for further studies is that we should analyze the 
computational complexity in network environment with OSPF 
as well as other existing approaches including PEFT 
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